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Abstract 

Attractor models are simplified models used to describe the dynamics of firing rate pro¬ 
files of a pool of neurons. The firing rate profile, or the neuronal activity, is thought 
to carry information. Continuous attractor neural networks (CANNs) describe the neu- 


ral processing of continuous information such as object position, object orientation and 
direction of object motion. Recently, it was found that, in one-dimensional CANNs, 
short-term synaptic depression can destabilize bump-shaped neuronal attractor activity 
profiles. In this paper, we study two-dimensional CANNs with short-term synaptic de¬ 
pression and with spike frequency adaptation. We found that the dynamics of CANNs 
with short-term synaptic depression and CANNs with spike frequency adaptation are 
qualitatively similar. We also found that in both kinds of CANNs the perturbative ap¬ 
proach can be used to predict phase diagrams, dynamical variables and speed of spon¬ 
taneous motion. 


1 Introduction 


Neurons communicate with each other through the neurotransmitter diffusion initiated 
by action potentials, or spikes, and the activity of one neuron can excite or inhibit the 
activity of another neurons. The firing rates of spike trains are thought to carry infor¬ 
mation and correlations between the firing rates of neurons depend on the strength of 


the couplings between t hose neurons. With some specific sett ings of couplings (e.g., 


Mexican-hat couplings (Amari 


1977 


Ben-Yish ai et all 


1995|)) networks of neurons 


can support a continuous family of local neuronal activity profiles on a field, which can 
be used to represent continuous infoimation, such as object position, object orientation 
and direction of object motion. 


Local neuronal activities associated with continuous infoimation are observed in 
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vario us brain regions. Typical examples of cells showing such a ctivity are head-directio n 


cells (ITaube et all 11990c iBlair & Shard. 1 19951: IZhand. 1 19961: iTaub e & Muller, 


998), 


place cells (10 ’Keefe & Dostrovskvl 1 197 ll: lO’Keefd. Il976l: lO’ Kee fe & Burgess, 1996; 


Samsonovich & M cNaug htonlll997r) and moving-direction cells (IMaunsell & van Essen . 


19831: iTreue et all 12000 ). These cells have Gaussian-like tuning curves as functions of 
stimulus. Among the numerous models proposed to describe behaviors of these sys¬ 
tems are continuous attractor neural networks (CANNs), and a recent study of per¬ 
sistent activity in monkey prefrontal cortic es has prov ided evidence of continuous at¬ 


tractors in the central nervous system. (IWimmer et al.. 2014)- Persistent neuronal ac- 


ti vity i n monkey s’ pre 


(IFunahashi et al.i 


fontal cortices was discoverec 


1993). The study by 


Wimmer et al. 


during delayed-response tasks 


(2014) confirmed that pairwise 


neuronal c orrelation predicted by theories can be observed in the 


vestigated (Ben-Yishai et al. 


19951: 


Pouget et al. 


1998 


Wu et al.. 


Train region they in- 


20080 


A one-dimensional (ID) CANN can support a family of Gaussian-like neuronal ac¬ 
tivity profiles. They are attractors of the network. As shown in Figure Oja), attractors 
have the same shapes and are centered at positions corresponding to different preferred 
stimuli. These Gaussian-like profiles can shift smoothly along the space of attractors. 
Families of attractor profiles in two-dimensional (2D) CANNs are similar: each attrac¬ 
tor profile is a Gaussian-like profile and centered at a particular position in the 2D field 


studied in the literature ( 

Ben-Yishai et al., 

1995; 

Samsonovich & McNaughton, 

1997; 

Wu et al.. 

2008; 

Fung et al.. 

2010 

). If couplings between neurons are static over time 
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Preferred Stimulus 



Figure 1: Examples of attractor states of continuous attractor neural networks (CANNs) 
in (a) a ID field and (b) a 2D field. In (a), profiles are centered at location z, the location 
they are representing. In (b), xq is the first coordinate of the preferred stimulus and x,\ 
is the second coordinate of the preferred stimulus. 


(quenched), the steady state of neuronal activity profiles will be static because of the ho¬ 


mogeneity and translational invariance of CANNs. If they depend on the firing histories 
of presynaptic neurons, howeve r, the dynamics of CANNs can be different. 


Tsodvks & Markraml ( 199711 proposed a model in which the synaptic efficacies be¬ 
tween neurons depend on the amount of available neurotransmitters in the presynap- 
tic neurons and this amount depends on the firin g history of the presynaptic neuron 


(ITsodyks & Markraml. 1 19971: iTsodvks et all Il998h . This kind of reduction in synap¬ 


tic efficacies, due to past presynaptic neuronal activity, is called short-term synaptic 


depression (STD). There a re repo rts that _short-term 


rich dynamics in CANNs (lYork & van Rossum . 


2009; 


synaptic de pressi on can exhibit 


Fung et all 


2012a). 


Fung et al. 


(2012a|) reported that in ID CANNs, short-term synaptic depression can destabilize at¬ 


tractor profiles. Within a broad range of strengths of divisive global inhibition, if we 
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increase the degree of STD to a moderate range, static activity profiles will be transla- 
tionally destabilized. After some translational perturbations, a bump-shaped profile can 
move spontaneously along the attractor space. In these scenarios, both bump-shaped 
static states and moving states can coexist. If we further increase the degree of STD, no 
static profile can be found. If the degree of STD is too large, the steady_state of th e sys 


tern can only be a trivial solution. Similar behavior is reported by 


York & van Rossum 


(12009) with a different model. We can see that the instability induced by STD can 


reshape the intrinsic dynamics of the system, even when no stimulus is presented. 

Network response in a CANN with static couplings is always lagging behind a con¬ 
tinuously moving stimulus. However, with short-term synaptic depression, due to the 


translational instability, the under 
to over-take the actual stimulus. 


ying dynami cs of the network can make the response 


Fung et al. 


(I2012bl) suggested that this behavior can 


be used to implement a delay compensation mechanism . Short-ter m synaptic depres 


sion can al s o induce glob al (ILeobel & Tsodvksl 120021) and local (IFung et al. 1201 3c 


Wang et al. . Unpublished!) periodic excitements of neuronal activity profiles. Th ese pe¬ 


riodic excitements can enhance information processing in the brain. [Fung et al. (!20131) 


recently proposed that periodic excitement driven by the intrinsic dynamics can improve 


the resolution of CANNs. 


Kilpatrick (120131) also proposed that the neuronal activity pat¬ 


tern may shift between one stimulus and another. These theories suggested that STD 
may enhance the capability of CANNs. 

Studies on CANNs with short-term synaptic depression are mainly on ID networks. 


In this paper, we discuss the intrinsic dynamics of bump-shaped solutions of two- 
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dimensional CANNs with short-term synaptic de pressio n. Othe_r 2D models possess 


rich dynam ical behaviors such as spiral w aves (IKilpatrick & BressloffL 1201 Oat) , breath¬ 


ing pulses (IKiloatrick & BressloffL 1201 Oat) and collisions of two bump-shaped profiles 


(lLu et q/.L l 2 01l|) . Here, we focus on the spontaneous motion of a single bump-shaped 


profile, and analyze its stability. We have also studied the influence of STD on the sizes 
of bump-shaped profiles and on their changes in shape. 

We study not only CANNs with STD, but also CANNs with spike frequency adap¬ 
tation. Spike frequency adaptation (SFA) is a dynamical feature commonly observed 
in neurons. Neurons ar e suppressed after prolonged firing. SFA can be generated by a 


numb 

er of mechanisms 

(Brown & Adams, 

1980 

Madison & Nicoll 

1984; 

Fleidervish et al. 

1996; 

Benda & Herz 


1003 

). It can also destabilize the amplitudes and positions of 


static bumps. SFA-induced destabilization of bump-shaped states in CANNs are re 


ported in the literature (e.g., 


Kilpatrick & BressloffL 


2010bl) . What we find in our study 


on CANNs with SFA is similar to what we found in the case with STD. SFA first desta¬ 
bilizes the translational mode and then the amplitudal mode. There is also a parameter 
region such that both spontaneous-moving-bump solutions and static-bump solutions 
can coexist. 

In this paper, in each case, CANNs with STD and CANNs with SFA, we first in¬ 
troduce the model we used to study the_problem and then analyze each scenario using 


the perturbative method proposed by iFung et al. (I2010f) . These sections are followed 


by a section discussing the comparison between theoretical and simulation results and 
discussing the limitations of the perturbative method. 
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2 The Model 


In this work we consider a 2D neural field, where neurons are located on a 2D field with 
positional coordinates x = (x 0 , x \). x can be interpreted as the preferred stimulus of 
the neuron sitting at that point in the 2D field. The state of a neural field is specified by 
the average membrane potential u (x, t) of neurons at x at time t. The neuronal activity 
of a neuron at x is given by a nonlinear function of u (x, t ): 

r ( X ’ f ) = U -B(t) 9 [ M (x> *)] ’ 

where 0 is the Heaviside step function and B (t) is the divisive global inhibition. The 
neuronal activity is related to the average firing rate of the neuron. The evolution of the 
global inhibition is given by 


t b 


dB (t) 
dt 


—B (£) + 1 + pk 


I dx.'u (x', t ) 2 0 [u (x', £)] , 


( 2 ) 


where k is the parameter controlling the strength of the divisive global inhibition and p 
is the density of neurons over the field. Here, B (t) is driven by u (x, t) 2 . This choice 
of driving term can simplify our calculations. As we will describe in the following, 
u (x, t) is a weighted sum of r (x, t). So B (t) effectively depends on r (x, t). Also, at 
the steady state, the magnitude of u (x, t) is directly proportional to that of r (x, /:). 

In the network, neurons are connected by excitatory couplings given by 

J(|x - X ' l)= 2^ eXP (-^2^)' <3) 
where | • | is the norm of the argument, a is the radius of effective excitatory connec¬ 
tions and J 0 is the intensity of average coupling over the field. The dynamics of u (x, t) 
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is governed by 


Ts ~~m ~" = -u(x,t) + p J dx.'J (|x-x'| )p(x',£)r (x',f) 

- V (x,f) + / ext (x,f). (4) 

J ext (x, t) is the external stimulus, p (x, t) is the portion of available neurotransmitters 
of the presynaptic neuron and v (x, t) is the dynamical variable corresponding to SFA. 
Since in this work, we are studying intrinsic dynamics in the network, J ext (x, t) is set 
to zero throughout the paper. 

The portion of available neurotransmitters of the presynaptic neuron at x, p (x, /:), 
evolves as 

dj) (x t ) 

Td dt = ~P (x, t) + 1 - T d (3p (x, t) r (x, t) . (5) 

The first term on the right-hand side of this equation is the relaxation of p (x, t) with 
time constant The last term is the consumption rate of neurotransmitters. (3 is a 
parameter proportional to the neurotransmitter consumption due to each spikes. This 
parameter controls the strength of STD. On the other hand, the dynamics of v (x, t) is 
given by 

dv 

Ti ~dt ( X,t ) = ~ v ( x,t ) +^fl u ( x ’ t )\ ■ ( 6 ) 

Ti is the timescale of SFA. 7 is the degree of SFA. / is the dependence of SFA variables 
on average membrane potential, which is a non-decreasing function. For simplicity, we 
have chosen 

/ (w) = uQ (u) . (7) 
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This choice is convenient for our analytic purpose and should not affect the main con¬ 


clusion qualitatively as long as the adaptation increases with the average membrane 
potential, u (x, t), which is correlated with the average neuronal activity. 

In the present study, we analyze CANNs with STD and CANNs with SFA sepa¬ 
rately. For the case of CANNs with STD, we set 7 = 0 . For CANNs with SFA, we set 
P = 0 . 


3 CANNs with STD 


3.1 Stationary Solution 


In this case, we set 7 = 0 and J ext (x, t) — 0 to suppress SFA at the moment. For 
P — 0, p (x, t ) = 1, two types of non-zero fixed point solutions to Eq. © exist when 

0 < k < k c = pjy/ (327T a): 



( 8 ) 


where pJ 0 “oo = 4(1 ± ^ 1 — k/k c )/(k/k c ) and z is an arbitrary location in the field 
representing the center of local excitation. It is expected that the fixed point solution 
with the larger amplitude is stable and the other is unstable. For r B = 0, consider 



(9) 


where 5u 00 (t) is the deviation of the profile from the fixed point solution. Then the 
differential equation of the deviation is 



(10) 
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Figure 2: Solution of pJoU 00 as a function of k/k c . For each k/k c less than 1, the larger 
solution of pJqUqq is stable and the smaller solution is unstable. 

Therefore the smaller fixed point solutions are unstable, while the larger fixed point 
solutions have stable amplitudes. For non-zero tb, we have to consider the dynamics 
of B(t). Let B(t) = B 0 + 5B(t), where B 0 = 1 + (k/k c ) ( pJou 00 ) 2 . The dynamics 


of the deviation from the fixed point solution is given by 



( 

\ 


( 

\ 


/ 

\ 

d 

pJ 0 du 00 (t) 



1 

-2 


pJo5u 00 (t) 


Ts dt 



— 







SB (t) 

) 


i ± s / 1 - e) 

_ T s 

tb y 


SB (t) 

/ 


Since the trace of the 2x2 matrix in Eq. (fTTl) is negative for tb < r s and the sign of the 
determinant is independent of t s / tb , the solution with the larger w 0 o is stable against 
perturbations in amplitude, while the solution with the smaller amplitude is unstable. 
The solution of w 0 o as a function of k/k c is shown in Figure |2j 
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For (3 > 0 and J ext (x, t) = 0, we approximate the attractor profiles of u (x, t) and 


1 — p(x, t) by non-moving Gaussian distributions 


u (x, t) = M 00 (t) exp 


1 - p (x, t) = poo (t) exp 


4a 2 I ’ 

I 12' 


2 a 2 


( 12 ) 

(13) 


Here, without loss of generality, we consider the case with z = 0. They are not the 
exact solutions of Eqs. ©, © and ©. In this ansatz, u (x, t) is assumed to have 
the same shape as that in the (3 = 0 case. The width of 1 — p (x, t) is different from 
u (x, t) because the shape of 1 — p (x, t) is similar to u (x, t) 2 at the small (3 limit. The 
differential equations governing u 0 o (t) and p 0 0 (t) can be obtained by projecting Eq. 
© onto exp[— |x | 2 /( 4a 2 )1 and projecting Eq. © onto exp[— |x | 2 /(2a 2 )]. 


As in the study by[Eung et al. 


(I 2012 al) . u (x, t) can be replaced by rescaled variables 


m (x, t) = pJ 0 u (x, t) because w 0 o (t) has a dimension l/(pj 0 ). u 0 o (t) = pJoUoo (t). 
And k and (3 can be rescaled by k = k/k c and (3 = /(p 2 Jq ). 

With these rescaled variables, the differential equations of // 00 (t), p 0 o it) and B (t) 


are 


du 00 / n 
(t) = 


Td- 


dt 

dpoo 

dt 

dB 


1 1 

-woo it) + 2 ^y“oo (ty 


Tb 


dt 


(t) = 

(0 = 


Poo (t) 


B(t ) 


f3u 00 c ty 


1 - yPoo (t) 
2 

1 - gPOO (t) 


B (t) + 1 + —kuoo ( t ) 2 . 

15 


(14) 

(15) 

(16) 


As we study the steady state behavior of the network, we need to solve for the fixed 
point solution first. For the first two differential equations, we may let (3B be given. 
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Figure 3: Parameter regions of existence of static profiles of u(x,t). Dashed curves: 


parabolas given by Eq. (fT71) for different f3B’ s. Solid line: boundary separating param¬ 


eter regions of static profiles of w(x, t) and silent phase. 
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Then we can solve u 00 /B and p 0 o- For a given j3B, k and 6 are related by 


k 


(T ) 2 [ (B rl 


16 



(17) 


The parabolas given by this equation for different (3B s are plotted as dashed lines in 
Figure [3l where we see that the static fixed point solution exists only when 



P<irk 


, if ^ < k < 1 


(18) 



By considering the stability of fixed point solutions, we obtain the solid line in Figure 
[3] (also the dotted line in Figure [4)). This curve maps the parameter region for the 
existence of static profiles of -u(x, t). The methodology for studying stability of fixed 
point solutions can be found in Appendix lAl 

3.1 Translational Instability 

We have simplified Eqs. ©, © and © by introducing the approximation given by Eqs. 
(fl2l) and (fl3l) . This simplification, however, is useful for studying only the amplitudal 
stability of a bump-shaped solution. For the translational stability, we need to consider 
the stability of the static solution against asymmetric distortions. Displacing originally 
aligned u (x, t ) and p (x, t ) profiles of a static solution is a reasonable test, as the dip 
of p (x, t) is generated by activities of neurons. If the solution is moving, the dip of 
p (x, t ) is always lagging behind. As a result, the asymmetric component of p (x, t ) 
with respect to the center of mass of u (x, t ) becomes non-zero. In the calculation, we 
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may drop asymmetric components of u (x, t) for the moment, as we can always choose 
a frame such that the major asymmetric mode is zero. 

Let us assume 


u (x, t) = u 00 (t) exp 
P (x, t) = poo ( t ) exp 



l x l \ , X 0 

— ) +Pwi t)-ex p 2fl2 


(19) 

( 20 ) 


Due to the symmetry of the preferred stimulus space, here we consider only the distor¬ 
tion along the x 0 -direction. By substituting these two assumptions into Eqs. ©, © and 
©, we can study the stability of static solutions against asymmetric distortions. With 
assumptions Eqs. (fl9l) and (l20l) . we can derive the stability matrix by calculating the 
Jacobian matrix at the fixed point solution. Then the dynamics of distortions of u 0 o (t), 
Poo (t), Pio (t) and B ( t) around the static fixed point solution is given by 




' dt 


OU00 (t) 


Spoo (t) 
5B (t) 
dp io (t) 


V 


( ^ \ 

£I?STD 0 

0 M 


/ 


OUoo (t) 


dpoo (t) 
5B (t) 
dpio ( t ) 


V 


( 21 ) 


/ 


where the 3x3 matrix .s^std is provided in Appendix [Aj £/ STD determines the amplitu¬ 
dal stability of the solution, while M determines translational stability, which is given 


by 


1 / . p 4^2 , T d 1 8 




M = -[- 1 +B9^ + 7 s B49^ 00 )- 


( 22 ) 


If M > 0, the static solution of two-dimensional CANNs with short-term synaptic 


depression will obviously be translationally unstable because positional distortion will 
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diverge. 

By studying the stability matrix, we found that bump-shaped solutions will be trans- 
lationally stable only if 


B 


Woo\ 2 Td 8 Moo ^ 1 

~B + ^ 49 - 0 Poo<1 ' 


(23) 


In this case, asymmetric distortions cannot initiate spontaneous motion. When this 
inequality does not hold, there will be a moving solution such that the bump-shaped 
profile can move spontaneously with a speed dictated by k, /? and Td/r s . This inequality 
provides a prediction of the boundary separating translationally stable static bumps and 
translationally unstable static bumps, which is plotted as a solid line in Figure 


3.2 Moving Solution 


In the one-dimensional situation, when k is small and (3 is relatively large, there may 


be spontaneous moving solutions ( Fung et al .. 12012a) . To analyze the moving solution, 
we need to consider higher-order expansions of u (x, t) and p (x, t). In general, u (x, t) 
and p (x, t) can be expanded by any basis functions. Here we have chosen eigenstates 


of quantum harmonic oscillator as basis functions. 


where 


U ( X > t) = Yl (0 ^*0 (£o) V’fcl (6) , 

ko,ki 

1 - P (x, t) = Pkoki ( f ) <Pko (£o) (6) , 

ko,k i 


(£i) 


1 

\J \/2Tra2 k k\ 


Hn 




(24) 

(25) 


(26) 


15 












Figure 4: Phase diagram of different phases under this theoretical framework. Circles: 
simulation results on translational stability. Squares: simulation results on amplitude 
stability. Triangles: simulation results on stability of moving bumps. Curves: corre¬ 
sponding theoretical predictions. Parameter: Td/r s = 50. 
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Figure 5: (a) Measurements and predictions ofuoo/B. Symbols: measurements from 
various k. Curves: different levels of predictions, (b) Measurements and predictions 
of (-u 2 o + ^02) / B. Symbols: measurements from various k. Curves: different levels of 
predictions, (c) Measurements and predictions of \J(u 2 0 — u 02 ) 2 + u{ x /B. Symbols: 
measurements from various k. Curves: different levels of predictions, (d) Measure¬ 
ments and predictions of the intrinsic moving speed. Symbols: measurements from 
various k. Curves: different levels of predictions, (a) - (d) Parameters: same as Figure 

SI 
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1 


Pk (£i) 


--Iln 


6 


exp 


e, 


2 1 


2a 2 


, i = 0,1. 


(27) 


\Jy/TTa2 k k\ V a , 

In these equations, = x t — c^f. c* is the f th -component of the velocity of the moving 
frame. H n is the n lh order physicists’ Hermite polynomial. As in the ansatz for static 
solutions (Eqs. (fl2l) and (fl3l) ). the widths of the basis functions for u (x, f) and p (x, f) 
are different. This choice makes the perturbative expansion more efficient, although the 
choice of basis functions can be arbitrary. 

After substituting Eqs. (l24l) and (1251) into Eqs. d2]), (|U) and © and projections on 


Eqs. (1261) and (1271) . we obtain 


du kokl 

dt 


(t) = 


Ukgki (f) T 2 a VhTTu k0+1M ( t ) \Jk()U ko —i )kl (f) 


2 a 
1 


"E l^fco,fci+i (0 vWx-i (f) 
XI C '5mo C 'mm 1 ^on 1 (*) «m, rai (0 


5(0 


5(f) 


nonimomi 


5 n 0 m 0 l 0 D'n 1 mih V "noni (0 ^momi (0 mi (0, 


7ionimomi/o^i 


(28) 


T d dPk ° kl (t) = ~p kokl (f) + y/fc 0 + lpfco+i.fci (0 “ y/hoPko-iM (0 


dt 


\/2l 


a L 


\/2a L 
5(f) 


dB . . 
(t) 


(^) \/ ^lPko,ki~ 1 (^) 

^ v -^nomo-^nJmi^Tioni (^) w m 0 mi (t) 
iimomi 

^nomo/o^nimi/i^orii (*) 'U'momi (0 Pioh (0 > (29) 

(30) 


/3 

5(f) 


nonimomi 


— 5 (f) + 1 + kp E ^koki (0 

koki 
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A detailed illustration of the derivation of these equations can be found in Appendix |B] 
Here, (f)’s are rescaled dynamical variables: u kokA (t) = pJoUk 0 ki (£)• Coefficients 
Cnm, D k nml , E k m and F k ml are defined by 

C* m = Jd^tojde-jL-e-- (31) 

£>Li = J din (0 J (?') y m (?) W (?), (32) 

bL= J dZMt) fdCMC) iM?), (33) 

= J dtf* (?) J <i?V„ (?') (?) W (?) • (34) 


k 

nml 


Cqo> B 000’ E oo and F o°oo can be calculated explicitly. For C* m , E k nm and F ? 

with arbitrary k, n, m and l, the recurrence relations used to generate these coefficients 


can be found in Appendix B in the paper by 


Fung el al. 


(12012aD . In practice, we cannot 


consider infinitely many u kokl (t) and p kokl (t ). We used finite terms to obtain fairly 
acceptable results. In Figures 0 and 0 ‘/c 0 + k\ — 3 Perturbation’ means that we 
consider terms up to k 0 + ki = 3. 

Unfortunately, the above equations cannot form a complete set of equations suffi¬ 
cient to solve for the fixed point solution. We also need to consider the self-consistent 
condition: 


/ d£u (£, t) & 
J dgu(£,t) 


= 0 . 


(35) 


This self-consistent condition helps us to choose the center of mass of u (x, t) to be 
origin of basis functions so that the perturbative method can be efficient. u kokl /B, 
p kokl and Cj can be solved numerically by regarding BB as a constant and setting time 
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derivatives equal to zero. For each j3B, k and (3 are related by 


k 



(36) 


Then fixed point solutions corresponding to each 



can be solved. 


By comparing the fixed point solution with the simulation results, we found that not 
only fixed point solutions but also various measurements of the network state are deter¬ 
mined by /3B as shown in Figure O In Figures Ob) andOc), we compare the values 
of the second-order variables between simulations and theoretical predictions by trans¬ 
forming them to the polar coordinates via £ 0 — r cos 6 and = r sin 6. We can convert 
second-order basis functions for u (x, t) to be combinations of their polar counterparts. 
Then we can obtain a linear combination of basis functions in polar coordinates: 


«20^2 (£o) V’o (fl) + U02^0 (fo) ^2 ( 6 ) + Ull^l (&) ^1 ( 6 ) 




(37) 


In order to compare predictions to simulation results without considering the moving 
direction in the 2D field, we use (u 2 o + u 02 ) /B (in Figure Ob)) and 


u 20 — w 0 2 — V2iuu\ /B (in Figure Oc)) for the case of k 0 + k\ = 2. (u 2 o + u 02 ) 


is the average change in the width of the bump-shaped profile relative to the closest 
static solution, while \u 20 — ^02 — y/2iun \ is the magnitude of the anisotropic mode. 
Illustrations of the polar functions in Eq. (l37l) are shown in Figure 0 

Since B is proportional to uf )0 , an increase of u 00 /B implies a decrease in u 00 . 
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Figure 6: Distortional modes for k 0 + k\ = 2. 


In Figure [51a), the slope of u 00 /B is discontinuous at about /3B « 0.0137. For 
/3B < 0.0137, the slope is significantly larger than that in the region of (3B > 0.0137. 
This implies that the motion of a bump helps the bump to maintain its magnitude. It 
also agrees with the tendency of the average membrane potential (or neuronal activity) 


profile in ID CANN t 


rat the bump tends to move to a region with a hi gher concentration 


of neurotransmitters (York & van Rossuml 


2009; 


Fung et all 


201 2 ah . 


Figure [5jc) suggests that an anisotropic mode happens only when the bump is not 
static, while Figure Ob) shows that the average width of ?/(x. t) profile increases with 
the strength of STD. The behavior of the average change in width, (u 2 o + u 02 ), is similar 
to that in height. The anisotropic mode happens only when the bump is moving. This 
suggests that the bump get widened unevenly due to the asymmetric p(x, t) profile. 


3.3 Phase Diagram 

In the previous subsection, we have shown that the perturbative method can successfully 
predict different modes of distortions of u (x, t) and the intrinsic speed of spontaneous 
motion. We have also predicted the phase boundary separating translationally stable 
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static bumps and translationally unstable static bumps. To predict different phases in 


the parameter space, however, we need to study the stability of fixed point solutions 
given by Eqs. (l28l) . (l29l) and (l30l) . A detailed discussion of the stability issue can be 
found in Appendix O 

By studying the stability of fixed point moving solutions, we can obtain a phase 
boundary separating silent and moving phases, as plotted as a dashed line in Figure 
HI In Figure |H there is a rather complete phase diagram for the model of 2D CANNs 
with STD we are studying here. For small enough /3s (below the solid curve in Figure 
H), since static bumps are stable in amplitude and translation, this parameter region 
supports only static bumps. This region is called the static phase. 

For parameters between the dotted line and the solid line, static bumps are stable 
in amplitude but unstable against translational distortions. So in this case, in a rather 
short time window, both static bumps and moving bumps are able to exist. Because 
once a translationally unstable static bump get perturbed, it becomes a moving bump. 
Since both static bumps and moving bumps are observed in this parameter region, we 
call it the bistable phase. If we further increase (3 , however, even static bump cannot be 
observed. And only moving bumps can be observed in the parameter region, we call it 
the moving phase. When both k and [3 are large, no non-trivial solution can be found in 
our analysis or simulations. 


In this study we did not find the homogeneous firing patterns reported by 


York & van Rossum 


( 2009f) . In the ID c ase , however, homogeneous firing can be found in the k —> 0 regime 


(IWang el al. 


Unpublished). Since we are focusing on moderate magnitudes of k, the 
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possibility of uniform firing behavior in 2D CANNs with STD near k — 0 is reserved 


for future studies. 

4 CANNs with SFA 

4.1 Stationary Solution 

By setting /3 = 0 in Eq. ©, the CANN model we are considering becomes a network 
with SFA only. To study the stationary solution in this case, we assume 



(38) 



(39) 


By substituting Eqs. (l38l) and (l39l) into Eqs. © and ©, we found that the fixed point 
solution is given by 



(40) 


(41) 


(42) 


(1 + 7) k 


Too is a rescaled variable defined by T 0 o = pJo^oo- Similarly, v 00 = pJ 0 v 0 o- We 
can also rescale w(x, t) and v(x,t) in the same way: i.e., u(x,t) = pJou(x,t ) and 
T(x, t) = pJ 0 v (x, t). For tb = 0, the fixed point solution with the larger T 0 o and v 00 is 
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stable whenever 


0 < k < 


l + 2 7 


\4 ’ 


(43) 


(1 + If) 

which is labeled by curve L in Figure [7]for k = 0.3. The stability issue can be studied 
by considering the dynamics of distortions of dynamical variables from their fixed point 
solutions. Let 


u (x, t ) = [w 00 + ^00 (*)] exp ^ 

.-£)■ 

(44) 

v (x, t) = [n 0 o + Svqo (i)] exp ^ 

x 2 \ 


4a 2 ) ’ 

(45) 

B{t) = B + 5B {t). 


(46) 


By studying the stability of fixed point solutions, we obtain a parameter region for static 
bumps with stable amplitudes. Detailed analysis of the stability issue can be found in 
Appendix iDl Regions for k = 0.3 and various (Tj/ 77 )s are shown in Figure [7] For 
tb > 0, the parameter region over the (k, 7) space becomes smaller as tb increases. At 
the Tj ^ r, limit, the range of k to stabilize the static solution is given by 


0 < k < 


27 + I 
(1 + 7 ) 4 ’ 


(47) 


which agrees with Eq. (l43l) . On the other hand, if t b /t s > 1, there will be no static 
solution. In Figure [71 we have shown that if 7 becomes larger, the maximum value of 
tb / t s to stabilize the static solution will be smaller. 
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Figure 7: Maximum tb/t s able to stabili z e the amplitude of stationary solutions as 
a function of 7, given that k = 0.3. L: maximum 7 of the existence of stationary 
solutions. 
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4.2 Translational Stability 


To study the translational stability, we consider the lowest-order asymmetric distortions 
added to the stationary solution. The major concern here is the step function in Eq. ([7]), 
but the step function does not have a first-order effect on translational distortions. We 
let 


u (x, t) = Moo (t) exp 
v (x, t) = M 00 (t) exp 


4a 2 
12 ' 


l X l , ,.x 

^ +M*)-exp. 4o2 


(48) 

(49) 


As we are studying the stability issue of the static solution, let us adopt the solution 
in Eqs. (l40l) - (l42l) and put m 10 = 0. Then the dynamics of distortions of dynamical 


variables near fixed point static solutions becomes 


/ 

ou 00 (f) 


d_ 

’ dt 


V 


5m 00 (t) 
SB (■ t) 
bv io it) 




SFA 


o - T f +7 
1 % 


\ 

/ 


/ 


OUOO {t) 


Svoo (t) 
5B (t) 
bv 10 (t) 


V 


(50) 


/ 


where the 3 x 3 matrix .c/sfa is provided in Appendix [Dl =c/sfa determines amplitudal 
stability of the static solution. Clearly, the variable m 10 becomes unstable if 7 > t s /t,;. 
This implies that if the dynamics of SFA is slow enough, the static solution will be 
translationally unstable. 
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4.3 Moving Solution 


Once 7 > r s /rj is satisfied, spontaneous motion of a bump-shaped solution in 2D 
CANN with SFA becomes possible. As in the STD case, however, lower-order expan¬ 
sions of u (x, t) and p(x,t) are not sufficient to describe the moving solutions. We 
have to consider higher-order expansions if we want to obtain good predictions on the 
behavior of moving solutions. Surprisingly, we found that a limited order of expansion 
of u (x, t) and v (x, t) can give some fairly good predictions on the moving solutions. 

In general, we consider 


U (x, t ) 'y ^ Uk 0 ki (t) (£o) (£l) J 


koki 


Here 


v ( x > t) = (*) &) 0*1 (6) • 

ko^ 


<t>ki (&) = 7 = H k . f-') exp (~Yz 

y/y /2 Trakj] \ a J \ 4 a 


(51) 

(52) 


(53) 


and H k . is the /;:J h -order probabilist’s Hermite polynomial. Eqs. (l40l) and (I4TI) become 


duk 0 ki ( ^ 
T ‘— (i) 


— u koki (0 ^ S (f) ^ ' r' n “ mo C n J mi u noni (i) u momi (i), 


nonimomi 


Ts c o 
2a . 

ACi 

2 a 


y/ k()Uk 0 —i : ki (f) y/ k 0 T (t) 

yAi^feo^i-i (0 yA7+Tw fe0ifcl+ i (f) 


(54) 


r, 


dVk 0 ki 

dt 


(t) 


Vfcofci (^) T 7Mfc 0 fci (t) 
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( 55 ) 



Together with the self-consistent condition, Eq. (l35l) . the fixed point solution is 
solvable. Here the definition of C^ rn is not the same as that in Eq. (fTil) . which is 
defined by 



(56) 


Cq o can be calculated explicitly. In general, C% m can be obtained by using the recur¬ 
rence relations given in Appendix [Ej 

If we consider only terms up to ko + k\ = 2 and motion along the ^o-direction, we 
can obtain the intrinsic speed of the moving solution (detailed derivation can be found 
in Appendix [0): 



(57) 


As the preferred stimulus space is rotationally symmetric, this speed is applicable to 
motion in any direction. Even though this is an approximated solution with relatively 
few terms, the prediction on the intrinsic speed is fairly good, as shown in Figure [8} 
This result suggests that, in this case, the terms with k 0 + ki < 2 are sufficient to 
give some good predictions on the behavior of bump-shaped solutions. For predictions 
on measurements of different components of the moving bump, however, we still need 
to use higher-order perturbation. In Figures [9(a) - (c), we have shown that higher- 
order perturbation is needed to predict : u feofel /-B if the bump is moving. As in Figures 
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Etb) and 0c), in Figures 0 b) and 0c), we do not compare u 2 o, Vm and uu directly. 
Since a moving bump can move in any directions, we compare their projections in 
polar coordinates. Let us consider £ 0 = r cos 6 and £1 = r sin 9. Then we have 

M 2O02 (Co) 00 (Cl) + M O20O (Co) 02 (Cl) + ^1101 (Co) 01 (Cl) 




(58) 


In Figures 0b) and 0c), we compare predictions and simulation results of (u 2 o + u 02 ) 


and \u 20 — u 02 — \f2iuu j for k 0 + k\ = 2 and k 0 + k\ = 10. (u 2 o + M 02 ) is the aver¬ 


age change in the width of the bump-shaped profile, while |m 2 o — «02 — y/2iun\ is the 
magnitude of the anisotropic mode. The graphical illustration of Eq. (l58l) is omitted 
because it is similar to the illustrations shown in Figure 0 

The behavior of moving solutions of CANNs with SFA is similar to that of moving 
solutions of CANNs with STD. For u 00 /B, its trend is basically the same as u 00 /B in 
the case with STD shown in Figure 0 The transition happens whenever 7 = t s /t % . 
Also, anisotropic modes will be available only when the bump is moving, while the 
width of the w(x, t) profile increases as the strength of SFA increases. The behavior of 
the average change in width is similar to the behavior of the change in height, u 00 . The 
dependence of anisotropic modes on the strength of SFA, 7 , implies that the widening 
effect is not uniform when the bump is moving, which is similar to what is seen in a 2D 
CANN with STD. 
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Figure 8: Speed of spontaneous motions as a function of 7 . 


4.4 Phase Diagram 

A phase diagram similar to Figure 0] for SFA can be obtained in a similar manner used 
for CANNs with STD. In the previous subsection, we have shown that perturbative 
analysis is able to predict dynamical variables of the model. By solving for the moving 
solutions numerically and testing their stability, we can predict the phase boundary 
separating parameter regions for moving solutions and trivial solution (silent phase). 
Using it together with the stability conditions for static bumps given in Eqs. (1431) and 
(l50l) . we can predict the phase diagram for SFA. We found that the predicted phase 
diagram matches the phase diagram obtained from computer simulations (Figure [T0l) . 
As in Figure 01 there are four phases in the phase diagram: a static phase, a bistable 
phase, a moving phase and a silent phase. Their meanings are the same as those of their 
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7 7 

Figure 9: (a) Projection of u (x, t) on 0 O (£o) 0o (£i)- (b) Projection of u (x, t) on ro- 
tationally symmetric basis function with k 0 + ki = 2. (c) Projection of u{x,t) on 
anisotropic basis function with k 0 + k i = 2. (a) - (c) Parameters: a = 0.5, Tijr s = 10 
and tb/t s = 0.1. 
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Figure 10: Phase diagram over the parameter space spanned by [k, 7 J. Dotted line: 
boundary predicted for moving solutions by k 0 + k\ = 2 perturbation. Solid line: 
boundary predicted for moving solutions by k 0 + k\ = 10 perturbation. Dotted line: 
boundary predicted for static solutions with stable amplitudes by k 0 + k\ =0 pertur¬ 
bation. Dot-dashed line: boundary predicted for static solutions with stable amplitudes 
and translational stability by k 0 + k\ =0 perturbation. Parameters: same as Figure [9j 
Symbols: corresponding simulations. 
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counterparts in Figure |4l Remarkably, expansions up to k () + k\ =2 can also predict 
the phase diagram well, which is similar to the prediction of intrinsic speed of moving 
bumps in CANNs with SFA. 

5 Discussion 

5.1 Intrinsic Phases and Phase Diagrams 

In the parameter spaces of the two models we studied in this paper, there are static, 
bistable, moving and silent phases. When [3 is large enough, moving bumps can be 
found in bistable phase and moving phase. This behavior can also be seen in the case of 
SFA. In both STD and SFA cases, whenever /3 or 7 is not too large (within the bistable 
phase), static bumps can still exist for a not insignificant period of time. If (3 or 7 is too 
large, only trivial solutions are stable. 

Behaviors of CANNs with STD are very similar to those of CANNs with SFA. This 
suggests that multiplicative dynamical suppression mechanisms (represented by STD) 
and subtractive dynamical suppression mechanisms (represented by SFA) can generate 
similar intrinsic dynamics, especially with regard to spontaneous motion. It also implies 
that other smooth models having homogeneous couplings and dynamical suppression 
mechanisms should have a similar phase diagram consisting of static, moving, bistable 
and silent phases. 

In some studies on CANNs with STD or SFA it is reported that, with_some pa¬ 
rameters, uniform firing pattern can be found in the network (e.g. I York & van RossumL 
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20091) . In the present study, uniform firing is not included because the interactive range 


of the global inhibition in this model is infinite. So uniform firing may only be found 
in a tight parameter region near k —> 0. For the ID STD case, uniform firing can be 


found in a region (3 —> 0 and k —> 0 (lWang el al. , 


Unpublished!) . Uniform firing should 


also be found in 2D CANNs with STD or SFA, as should spiral waves and breathing 


wavefronts. Th ere is a repo rt on spira 


with STD (e.g. 


Kilpatrick & Bressloff, 


waves and breathing wavefronts in 2D CANNs 


2010 ah . but those phenomena are missing from 


the phase diagram we predicted because spiral waves and breathing wavefronts are not 
local patterns. Therefore in the present model they may exist if the magnitude of divi¬ 
sive global inhibition is very small. Richer dynamics of the present model for k —* 0 is 
reserved for future investigations. 


5.2 Effectiveness of Perturbative Approach 

In this paper we have shown that, in the present particular model, the perturbative expan¬ 
sion method is applicable to the study of continuous attractor neural networks (CANNs) 
with short-term synaptic depression (STD) or spike frequency adaptation (SFA). We 
found in this study that both STD and SFA can drive similar intrinsic dynamics of the 
local neural activity profile. In Figures l4l and ITOl there are four phases: silent, static, 
bistable and moving. Using perturbative expansions on the dynamical variables, we 
can successfully predict the phase diagrams in both cases with STD and SFA. 

As expected, with low-order expansions (i.e., when k 0 + k\ is small), predictions 
on Uk 0 fci’s of the static solutions work well in cases with STD and SFA. For moving 
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solutions, higher-order expansions are needed to obtain more accurate solutions. In 
Figures [51 a) - (c) and Figure [9]it is shown that low-order perturbative expansions, A: 0 + 
k\ — 3 for STD and ko+ki = 2 for SFA, are able to show the general trend of dynamical 
variables. Especially, the second-order transitions in all the dynamical variables (i.e. 
discontinuities of slopes) are observed at this level of perturbative expansion. This 
suggests that low-order perturbative expansions are good enough for studying general 
phenomena in different phases. 

To predict the behavior of the dynamical variables more accurately, we need to use 
higher-order perturbative expansions. We have shown in Figures [51a) - (c) and Figure 
[9] that higher-order perturbative expansions, k 0 + k\ = 11 for STD and k {) + k\ = 10 
for SFA, can fit measurements from simulations accurately. Higher-order terms do not, 
however, significantly improve prediction of the speed of spontaneous motion. This 
suggests that lower-order perturbative modes are most important to the motion of the 
local neural activity profile. 

5.3 Asymmetric Modes and Moving Solutions 

Higher-order perturbative modes are essential for predicting the behavior of dynamical 
variables of moving solutions accurately because the dynamical variables will become 
asymmetric about the center of mass of u (x, t) if the neural activity profile is moving. 
In Figure [HI there are two examples of CANNs with different levels of STD. Figures 
ITTT a) andQjIc) are with /3 = 0.001, which corresponds to the static phase. In this case, 
both the average membrane potential profile u (x, t) and the fraction of available neu- 
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Figure 11: Snapshots of u (x, t) and p (x, t) in the static phase ((a) and (c)) and moving 
phase ((b) and (d)). (a) and (b) are u (x, t), while (c) and (d) are p (x, t). Dashed lines: 
contours for u (x, t) = 4. (* 0 , Zi) is the center of mass of u (x, t). The moving direction 
of the bump is the (1,1) direction, shows by the arrows in (b) and (d). Parameters: 
k = 0.5, Td/r s = 50 and (3 = 0.001 for (a) and (c), and (3 = 0.1 for (b) and (d). 
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rotransmitters p (x, t) are rotationally symmetric about the center of mass of u (x, t). 
Therefore, in the static phase, low-order perturbation is good enough for making pre¬ 
dictions. 

Snapshots of u (x, t) andp (x, t) in the moving phase are shown in Figures [mb') and 
did). Here the level of STD is /? = 0.1. In this case, u (x, t) seems to be rotationally 
symmetric about its center of mass. Actually, the shape of the Gaussian-like average 
membrane potential profile is slightly squeezed along the moving direction. For p (x, t), 
however, the deformation of the shape is more significant. In Figure did), the profile 
of p (x, t) is strongly biased against the moving direction. This highly skewed profile 
of p (x, t ) makes high-order perturbative mode more important, especially for cases 
involving stability and predictions of dynamical variables. 


5.4 Limitation of Perturbative Approach 


In this paper, we have shown the perturbative approach is able to successfully predict 1) 
the phase diagrams of CANNs with STD or SFA, 2) the speed of spontaneous motion 
and 3) the dynamical variables (e.g. u(x,t)). Phenomena richer than spontaneous 
motion of local neural activity, for example, breathing wavefront s on neural networks 


have been considered theoretically dKilpatrick & BressloffL [2010a). The perturbative 
formulation is not applicable in that case, however, because the basis function we used 
here are local, while the traveling wavefronts are globally spreading. For the same 
reason, this method cannot be used to analyze also spiral waves on a 2D field. 


In the case of collisions of two moving bump-shaped profiles of neuronal activity, 
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one may find the dynamics hard to analyze by the perturbative method. This is because 
there are two centers of mass, one for each bump, and this makes the choice of the 
origin of basis functions confusing. For example, if one chose one of the centers of 
mass to be the origin of basis functions, the chosen family of basis functions will not be 
optimal for the other bump and will make the expansion of that bump less efficient. 

Conclusion 

In this paper we studied models with short-term synaptic depression and spike fre¬ 
quency adaptation and these models which was based on a two-dimensional CANN 
model with divisive global inhibition. We found that their intrinsic dynamics were sim¬ 
ilar. First, there are four phases in each scenario. They are static, moving, bistable and 
silent. The moving phase is the phase in which the bump-shaped profile moves spon¬ 
taneously, while the static phase is the phase in which the bump-shaped profile cannot 
move spontaneously. Interestingly, in the bistable phase, the CANN can support both 
moving profiles and static profiles. 

Second, there are clear phase transitions between static solutions and moving solu¬ 
tions. In Figures[5][8]and[9]there is a clear discontinuity in slope between the two states. 
This suggests that, spontaneous motion can affect the shapes of the bump-shaped pro¬ 
files. 

The stability of steady states, the shapes of the dynamical variables and the speed of 
spontaneous motion can be predicted by perturbative analysis, but perturbative method 
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cannot be used in some scenarios including spiral waves, breathing wavefronts and 


collisions of multiple bumps in 2D fields. 
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Appendix 

A Amplitudal Stability of Bumps on 2D CANNs with STD 

To study the stability of fixed point solutions of Eqs. (fl4l) - (fT6l) . we assume 


u 00 (t) — u 00 + Su 00 (t) > 


(A.l) 


Poo (t) = Poo + Spoo (t) , 


(A.2) 


B (t) =B* + 5B (t). 


(A.3) 


Linearizing Eqs. (fl4l) - (fl6l) . we obtain 


«oo (t) 
d 

T ’Jt P»» (0 

v B(t] / 


Woo (t) 

•^STD p Q0 (t) 



(A.4) 
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where 
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mo 


(A.6) 
(A.7) 
(A.8) 


By calculating eigenvalues of this matrix for a given fixed point solution, we can test 
the stability of each solution. In Figure [3] the parabolas are plotted from (3 = 0 to a 
point such that the real part of one of the eigenvalues just turns positive. The solid line 
in Figure [3] maps the parameter region for the existence of static profiles of u(x. t). 

For the stability matrix in Eq. (12TT) . since p w = 0 for static states, amplitudal 
stability and translational stability are uncoupled. The .c/std in the 4x4 matrix in Eq. 
(|2TT) is the same as that given in Eq. (IA.5I) . 
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B Derivations of Eqs. (1281) - (l30l> 


To obtain Eqs. (l28l) - (l30l) . we need to deal with differentiations of basis functions x/j k (£) 
and ip-, fc(£): 

d^kJX) = (^) _ J-Vfc + l^fc-i (0 (B.l) 

at, 2a 2a 

diPk ^ = —(f) - -^-y/h + ltpk-.! (f) (B.2) 

at, V 2 a v 2 a 

Combining this result with Eqs. (l24l) . (|25T) . we have 
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k okl l dt ^ 2a L 

\/ fc i + ipfco.fci+i (t) - y/kiPkoM-1 (*) f^fco (■Co) (£i) (B.4) 


\/2l 


a L 


We now obtain the left-hand sides of Eqs. © and ©. For the right-hand sides, by 
substituting Eqs. (l24l) and (l25l) into right-hand sides of Eqs. © and © and projecting 


them onto corresponding basis functions, we obtain 
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(B.5) 


1 - p (x, t) - r d /3p (x, t) 



J^Pfcofci (t) Pko (£o)<Pki (fi) 



^ (6) ^ (6) ( Y1 ■^nomo-® 




Here argument t of u kokl and p kokl are omitted. J (|x — x'|) = J 0 1 J (|x — x'|). Com¬ 


bining expressions of the left-hand and right-hand sides of Eqs. © and ©, we should 
obtain Eqs. (l28l) and (|29|) . Eq. (l30l) can be obtained easily by substituting Eq. (l24l) into 
Eq. © and making use of the orthogonality of ijj ki (£*)’s. 

C Stability of Moving Bumps on 2D CANNs with STD 

To study the stability issue, let us define 
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The stability of fixed point solutions can be determined by considering the stability 
matrix given by 
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dF(uoo,— ,poq,— ,B\u 00 ) 
dpoo 


8F(uqo,--- ,poo,--- ,-B|poo) 

dpoo 


dF(upo,— ,pqo,— ,B\B) 
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dF(uoo,— ,poq,— ,B|mqq) 

8B 


dF(upo ,■■■ ,poo,--- ,B\poo) 

dB 
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dF(u 00 ,--- ,p oo,-" , B \B) 
8B 


(C.4) 


For dynamical variables near their fixed point solutions, we let 


'Ukoki (t) — ^kok\ F 3Ukoki (f) j 

(C.5) 

Pkoki (f) = Pkpki F ^Pkok\ {t) > 

(C.6) 
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B (t) = B* + 5B (t ), 


(C.7) 


where u* kokv p* kokl and B* is the fixed point solution. Then the dynamics of Suk 0 k x ( t ), 
5p k0 fci (t) and SB ( t ) can be formulated as 


d 

Ts Jt. 


^ ^“00 ( t ) ^ 


Spoo (t) 


— n/ movin S 

— ^ STD 


/ 

0^00 [t) 


Spoo (t) 


(C.8) 


v SB(t) f y SB (t) j 

The fixed point solution is stable only if the maximum of the real parts of eigenvalues 
of 


^moving 

■^STD 


is non-positive. In general, those eigenvalues can only be calcu- 

U 001 — ’P00’ — ’B* 

lated by numerical methods. The predicted phase boundary separating the moving and 
silent phases shown in Figure 0] can be deduced, and the prediction can be verified by 
simulations. 


D Amplitudal Stability of Bumps on 2D CANNs with SFA 

For our convenience we define 


Ku 00 (woo, vqo, B) 
Kv 00 ( M 00, Vqq,B) 
Kb (wqoj v och B) 
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Ti 
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(D.3) 
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Then the stability matrix is given by 
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■C/ S FA — 
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dv 0 o 

dB 
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dB 
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du 0 o 

dv 00 

dB 
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-1 + 2 (l + 7 ) -1 

^7 


T s 


-2(1+7 y 
0 


\ 


Ts l±\/l — (l+7) 2 fc n 

\ r s 2(1+7) 


The dynamics of distortions becomes 


Ts 

TB 


( Su m (t) ^ 


Ts dt 


\ 


dv oo (£) 
5B (t) 


/ 

OUqO (t) 


^SFA 


7 


V 


<h>oo (t) 

55 (t) 
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(D.4) 


(D.5) 


If real parts of all eigenvalues of ^sfa are non-positive, the static fixed point solution 
is stable. For the ^fa in Eq. ([50b . since symmetric terms and asymmetric terms are 
uncoupled for static bumps, that £/sfa is the same as the matrix we have shown in this 
section. 


E Recurrence Relation of Cl L for CANNs with SFA 
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We have defined C^ rn in Eq. 
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To derive the recurrence relations, we first consider 
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Here we obtain this identity by using multiple integration by parts. Then, we have 

2 x' 
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(E.5) 


To relate C k m and C k , m , we need to use the recursion relations of probabilist’s Hermite 
polynomials: 


H n+ 1 (x) = xH n (x) - H' n (x) 
Hi (x) = (x). 


and 


(E. 6 ) 
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Then we can derive 
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Also, 
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For k — m — n — 0, we have 


c= !^/* exp (~£> 

^2 1 /3vra 2 

\/3 (270 3 at V 2 

1 

\/~\/8na 


(E.ll) 


By using Eqs. (IE.8I) . (IE.9I) and (IE. 101) and Cq 0 , we can generate any C^ m needed for 
numerical computations. 


F Intrinsic Speed of Moving Bumps on 2D CANNs with SFA 

Here we consider terms up to k 0 + k\ = 2. And for simplicity we assume c = (c 0 , Ci) = 
(c, 0). Then, 

E Uk 0 k ! (0 0 fc O ( 6 ) 0*1 ( 6 ) 

= MOO (0 00 (Co) 00 (Cl) 

+ Mo 2 (0 "00 (Co) 02 (Cl) + m 20 (0 02 (Co) 00 (Cl) ) (FT) 

M (£, 0 = M 00 (0 00 (Co) 00 (Cl) + Mio (0 01 (Co) 00 (Cl) 

+ M 02 (0 00 (Co) 02 (Cl) + M 20 (0 02 (Co) 00 (Cl) ■ (F.2) 

Note that, since c\ = 0, terms that are asymmetric along the £|-direction are dropped. 
The derived speed should be applicable to any direction because the model is homoge- 
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neous. 


By projection and orthogonality of the basis functions, Eqs. © and © give 
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(F.3) 

(F.4) 


(F.5) 
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(F.7) 

(F.8) 

(F.9) 

(F.10) 


From these equations we can deduce the ratio between m 0 q — V / 2w 2 o and m 0 q — a/2w 2 o 
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v 00 — 1 /2t , 20 — — (^00 — V / 2«20 
A V 

Combining Eqs. (IF.4I) . (IF. 71) and (IF. 101) . we have 


(F. 12) 
(F.13) 

(F.14) 

As shown in Figure [8], this formula can be verified by simulation. 



G Stability of Moving Bumps on 2D CANNs with SFA 


Using a method similar to that used in Appendix [0 we define 
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Then, the matrix concerning the stability issue is 
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Similarly, the dynamics of distortions is given by 


d_ 
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^ Su 00 (f) ^ 


Sv oo (t) 


\ &B(t) j 


= <T mg 


OUqq (t) 


Sv oo (t) 


y SB it) j 


(G.5) 


Here Suk 0 k 0 (t), Svk 0 k 0 (t) and SB ( t ) are defined by 


Vkoki (t) — u kokl SUkgkx (t) , 

(G.6) 

v ko k i (t) = v* koki + Sv kokl (t) , 

(G.7) 

B (t) = B* + SB (t ), 

(G.8) 


where u* kokl , v* koki and B* are the fixed point moving solution to the system. By calcu¬ 
lating eigenvalues of stability of the fixed point solution can be determined. 
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